The Average Laboratory Samples a Population of 7,300 Amazon Mechanical Turk Workers
نویسندگان
چکیده
Using capture-recapture analysis we estimate the effective size of the active Amazon Mechanical Turk (MTurk) population that a typical laboratory can access to be about 7,300 workers. We also estimate that the time taken for half of the workers to leave the MTurk pool and be replaced is about 7 months. Each laboratory has its own population pool which overlaps, often extensively, with the hundreds of other laboratories using MTurk. Our estimate is based on a sample of 114,460 completed sessions from 33,408 unique participants and 689 sessions across seven laboratories in the US, Europe, and Australia from January 2012 to March 2015.
منابع مشابه
Privacy Attitudes of Mechanical Turk Workers and the U.S. Public
Amazon Mechanical Turk (MTurk) is a crowdsourcing platform widely used to conduct behavioral research, including studies of online privacy and security. We studied how well the privacy attitudes of MTurk workers mirror the privacy attitudes of the larger user population. We report results from an MTurk survey of attitudes about managing one’s personal information online and policy preferences a...
متن کاملMoral Reminder as a Way to Improve Worker Performance on Amazon Mechanical Turk
The present study explores a method to reduce abusive worker behavior on Amazon Mechanical Turk (AMT), namely reminding workers of moral standards. We manipulated workers’ awareness of moral standards via the presence or the absence of an honesty statement in a survey. The results showed that the honesty statement significantly improved workers’ performance during the first half of the survey. ...
متن کاملA Data-Driven Analysis of Workers' Earnings on Amazon Mechanical Turk
A growing number of people are working as part of on-line crowd work. Crowd work is often thought to be low wage work. However, we know little about the wage distribution in practice and what causes low/high earnings in this setting. We recorded 2,676 workers performing 3.8 million tasks on Amazon Mechanical Turk. Our task-level analysis revealed that workers earned a median hourly wage of only...
متن کاملThe Language Demographics of Amazon Mechanical Turk
We present a large scale study of the languages spoken by bilingual workers on Mechanical Turk (MTurk). We establish a methodology for determining the language skills of anonymous crowd workers that is more robust than simple surveying. We validate workers’ selfreported language skill claims by measuring their ability to correctly translate words, and by geolocating workers to see if they resid...
متن کاملDetermining Functional Attributes of Objects in Images
I have used a data-driven approach to detect functional attributes of objects in images. Using ImageNet and Amazon Mechanical Turk, I have created a dataset of more than 7000 images with functional attribute labels. I have used these labels to train functional classifiers, and I compared the precision and recall of these classifiers to the precision and recall of the Amazon Mechanical Turk work...
متن کامل